(19) Japan Patent Office (JP) 



(12) Japanese Unexamined Patent 
Application Publication (A) 



(11) Japanese Unexamined Patent 

2000-47651 A 
(43) Publication date February 18, 2000 



(51) Int. CI. 7 
G09G 5/00 



H04N 



5/36 
7/18 



Identification symbols 
510 
530 
510 



FI 
G09G 



H04N 



5/00 

5/36 
7/18 



510X 
530M 
510M 
U 



Theme code (Reference) 
5C054 
5C082 



(21) Application number HI 0-2 1425 8 



(22) Date of application July 29, 1 998 



Status of examination: Not yet requested No. of claims: 10 OL (Total of 13 pages) 



(71) Applicant 



(72) Inventor 



(72) Inventor 



(74) Representative 



000006013 

Mitsubishi Electric Corporation 

2-3, Marunouchi 2-chome, Chi- 

yoda-ku, Tokyo, Japan 

Kaoru KAWASAKI 

c/o Mitsubishi Electric Corporation 

2-3, Marunouchi 2-chome, 

Chiyoda-ku, Tokyo, Japan 

Kazuya SATO 

c/ o Mitsubishi Electric Corporation 

2-3, Marunouchi 2-chome, 

Chiyoda-ku, Tokyo, Japan 

100057874 

Patent Attorney 

Michiteru Soga (and 6 others) 

continued on the last page 



(54) Title of the Invention 

Picture reproducer 

(57) ABSTRACT 
Problem 

Conventional picture reproducers simultane- 
ously reproduce and display image data only 
with a single display method, so they had a 
problem that display methods needed to be 
switched in monitoring or analyzing an image. 
Means for Solving the Problem 
An image data input part for sequentially input- 
ting image data comprising temporarily con- 
secutive pictorial data, a first image display part 
for displaying the image data input from said 
image data input part via a first display method 
(moving image 301), and a second image dis- 
play part for displaying the image data input 
from said image data input part via a second 



display method (parallel display 401) different 
from said first display method are provided. 
Effect 

Facilitating observation with fine pictures 
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Claims 

[Claim 1] A picture reproducer comprising: 
an image data input part for sequentially input- 
ting image data comprising temporarily con- 
secutive pictorial data; 

a first image display part for displaying the im- 
age data input from said image data input part 
via a first display method; and 
a second image display part for displaying the 
image data input from said image data input part 
via a second display method different from said 
first display method. 

[Claim 2] The picture reproducer according to 
Claim 1, wherein said first image display part 
sequentially displays the pictorial data input 
from said image data input part in a predeter- 
mined first image dimension, and at the same 
time, said second image display part sequentially 
displays the pictorial data input from said image 
data input part in a predetermined second image 
dimension different from said first image di- 
mension. 

[Claim 3] The picture reproducer according to 
Claims 1 or 2, wherein said first image display 
part displays the pictorial data to be sequentially 
displayed overlapping at a fixed position on the 
display screen, and at the same time, said second 
image display part displays the pictorial data to 
be sequentially displayed in parallel on a plural- 
ity of predetermined display positions different 
from said fixed position on said display screen. 
[Claim 4] The picture reproducer according to 
Claims 1, 2, or 3, wherein said first image dis- 
play part sequentially displays the pictorial data 
input from said image data input part at prede- 
termined first time intervals, and at the same 
time, said second image display part sequentially 
displays the pictorial data input from said image 



data input part at predetermined second time 
intervals different from said first time intervals. 
[Claim 5] The picture reproducer according to 
Claim 1, wherein said image data input part se- 
quentially inputs, decodes, and outputs digital 
compression-encoded image data. 
[Claim 6] The picture reproducer according to 
Claim 1, wherein said image data input part in- 
puts pictorial data of each frame comprising 
images in conjunction with additional informa- 
tion of those frames as data of those frames in 
inputting said image data, and at the same time, 
said second image display part displays the ad- 
ditional information of the displayed image by 
specifying the displayed pictorial image. 
[Claim 7] The picture reproducer according to 
Claim 6, wherein said second image display part 
only displays pictorial data that complies with a 
predetermined condition among a plurality of 
sets of pictorial data displayed in parallel at pre- 
determined positions on the same display screen 
according to a display method different from the 
other pictorial data. 

[Claim 8] The picture reproducer according to 
Claim 1, wherein said second image display part 
compression-encodes pictorial data input from 
said image data input part via a method different 
from the pictorial data and accumulates it in a 
buffer, and in performing a consecutive image 
display process, it retrieves the compres- 
sion-encoded pictorial data from said buffer, and 
reproduces and displays it. 

[Claim 9] The picture reproducer according to 
Claim 1 , wherein said second image display part 
displays a pictorial image resulted from per- 
forming a predetermined image conversion 
process on pictorial data input from said image 
data input part and reproduced. 
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[Claim 10] The picture reproducer according to 
any of Claims 1 to 9 characterized as displaying 
superimposed image displays by said first and 
second image display parts on the same display 
device. 

Detailed Description of the Invention 
[0001] 

Field of the Invention 

The present invention relates to a picture repro- 
ducer used to monitor, search, and analyze im- 
ages input by ITV cameras and the like. 
[0002] 

Relevant Art 

A conventional picture reproducer only displays 
one type of display at one time. For example, a 
VCR (video cassette recorder) only reproduces 
and displays images recorded on videotapes. 
[0003] Moreover, a VCR compatible with a plu- 
rality of ITV cameras used for a monitoring sys- 
tems or the like, for example, simultaneously 
record and play image signals input from a plu- 
rality of ITV cameras. In this case, a plurality of 
image signals are recorded overlapping and re- 
produced on one image signal. Image signals 
consist of a plurality of temporarily consecutive 
pictorial images (described as frame imagery). 
As a method of overlapping a plurality of image 
signals, for example, each frame imagery at the 
same time point obtained from a plurality of 
image signals is aligned in parallel to synthesize 
into one frame of a pictorial image, and the syn- 
thesized pictorial image is recorded as frame 
imagery after overlapping. In reproducing, a 
plurality of images is simultaneously reproduced 
by reproducing the overlapped image signals 
unmodified. In this case, one image signal con- 
taining data of a plurality of images is displayed 



by one image playing means rather than by a 
plurality of image reproduction means. 
[0004] Moreover, for example, some picture re- 
producers used to search and edit images or the 
like reproduce and display images by a plurality 
of different display methods. 
[0005] A conventional picture reproducer is ex- 
plained with reference to drawings. For example, 
Figure 15 is a drawing showing a simplified dis- 
play example of a display example of a conven- 
tional image editing device indicated in the 
"Study of a method of detecting scene changes 
from MPEG-encoded image data," IEICE Tech- 
nical Report, NIM97-69. 

[0006] In Figure 15, a display part 1501 is dis- 
playing some frames (specifically, representative 
frames immediately after scene changes) of 
many frames comprising images in parallel. In 
this conventional example, as shown with the 
display part 1501 in Figure 15, some frames of 
recorded images are first displayed in parallel. 
By specifying an intended frame among the 
frames displayed in parallel, image data con- 
taining those frames is then retrieved, and a 
moving image is displayed as with a display 
part 1502. In this case, the display part 1501 that 
displays in parallel and the display part 1502 
that displays a moving image reproduce and dis- 
play different image data and do not operate si- 
multaneously. 

[0007] Furthermore, some picture reproducers 
used for analyzing images and the like display 
each consecutive frame of an input image signal 
in parallel on the display screens, but no picture 
reproducers provide a parallel display and a 
movie display simultaneously. 
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[0008] 

Problem to be Resolved by the Invention 

The convenient picture reproducers described 
above simultaneously display image data only 
with a single display method, so display meth- 
ods need to be switched when monitoring or 
analyzing images. For example, to stop repro- 
duction for observation while the image is being 
reproduced, a few frames of the reproduction the 
display advance during the time from specified 
suspension of reproduction using a human ma- 
chine interface until the reproduction the display 
process of the image reproduction the display 
part actually stops, so there is the problem that 
an intended pictorial image needs to be searched 
via an operation of frame-by-frame rewinding or 
the like. 

[0009] Moreover, in a method of sequentially 
displaying a plurality of frame imagery by 
two-dimensional alignment on the same display 
screen (hereinafter referred to as "thumbnail 
display"), the problem described above that an 
intended pictorial image is overlapped by a pic- 
torial image to be subsequently displayed rarely 
occurs, but there is the problem that it is difficult 
to find minute domain changes or changes in 
movement of an object or the like on the screen. 
[0010] The present invention has been devised 
to solve the abovementioned problems and is 
intended to provide a picture reproducer that 
facilitates observation with fine pictures. 
[0011] 

Means of Solving the Problem 

The picture reproducer related to the present in- 
vention is provided with an image data input 
part for sequentially inputting image data com- 
prising temporarily consecutive pictorial data, a 
first image display part for displaying the image 
data input from said image data input part via a 
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first display method, and a second image display 
part for displaying the image data input from 
said image data input part via a second display 
method different from said first display method. 
[0012] The picture reproducer related to the 
present invention has said first image display 
part sequentially display the pictorial data input 
from said image data input part in a predeter- 
mined first image dimension, and at the same 
time has said second image display part sequen- 
tially display the pictorial data input from said 
image data input part in a predetermined second 
image dimension different from said first image 
dimension. 

[0013] The picture reproducer related to the 
present invention has said first image display 
part display the pictorial data overlapping to be 
sequentially displayed at a fixed position on the 
display screen, and at the same time has said 
second image display part display the pictorial 
data to be sequentially displayed in parallel on a 
plurality of predetermined display positions dif- 
ferent from said fixed position on said display 
screen. 

[0014] The picture reproducer related to the 
present invention has said first image display 
part sequentially display the pictorial data input 
from said image data input part at predetermined 
first time intervals, and at the same time has said 
second image display part sequentially display 
the pictorial data input from said image data in- 
put part at predetermined second time intervals 
different from said first time intervals. 
[0015] The picture reproducer related to the 
present invention has said image data input part 
sequentially input, decode, and output digital 
compression-encoded image data. 
[0016] The picture reproducer related to the 
present invention has said image data input part 
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input pictorial data of each frame comprising 
images in conjunction with additional informa- 
tion of those frames as data of those frames 
when inputting said image data, and at the same 
time has said second image display part display 
the additional information of the displayed im- 
age by specifying the displayed pictorial image. 
[0017] The picture reproducer related to the 
present invention has said second image display 
part only display pictorial data that complies 
with a predetermined condition among a plural- 
ity of sets of pictorial data displayed in parallel 
at predetermined positions on the same display 
screen according to a display method different 
from the other pictorial data. 
[0018] The picture reproducer related to the 
present invention has said second image display 
part compression-encode pictorial data input 
from said image data input part via a method 
different from the pictorial data and accumulates 
it in a buffer, and in performing a consecutive 
image display process, said second image dis- 
play part retrieves the compression-encoded 
pictorial data from such a buffer, and reproduces 
and displays it. 

[0019] The picture reproducer related to the 
present invention has said second image display 
part display a pictorial image resulted from per- 
forming a predetermined image conversion 
process on pictorial data input from said image 
data input part and reproduced. 
[0020] The picture reproducer related to the 
present invention the displays image displays 
superimposed by said first and second image 
display parts on the same display device. 



[0021] 

Embodiments of the Invention 

Embodiment 1 

The picture reproducer related to Embodiment 1 
of the present invention is explained with refer- 
ence to drawings. Figure 1 is a block diagram 
showing the overall constitution of the picture 
reproducer related to Embodiment 1 of the pre- 
sent invention. Moreover, Figure 2 is a drawing 
showing a constitution of an image data input 
part of the picture reproducer related to Em- 
bodiment 1 of the present invention. Further- 
more, in each drawing, identical reference nu- 
merals show identical or corresponding parts. 
[0022] In Figure 1, 1 is an image data input part, 
2 is a control part, 3 is a first image display part, 
4 is a second image display part, and 5 is a dis- 
play device. 

[0023] In Figure 2, 101 is an image signal input 
I/F, 102 is an A/D conversion part, 103 is a 
frame separation-detecting element for detecting 
the separation of frames comprising images, 104 
is a switch for switching frame buffers to be de- 
scribed later that record digitized pictorial data, 
105 and 107 are frame buffers, 106 and 108 are 
sets when data within each frame buffer is indi- 
cated as readable by a flag for indicating that the 
data is readable, and are reset when the data is 
indicated as unreadable. 

[0024] Next, the operation of the picture repro- 
ducer related to Embodiment 1 described above 
will be explained with reference to drawings. 
Figure 3 is a diagram showing an example of the 
display screen of the picture reproducer related 
to Embodiment 1 of the present invention. 
Moreover, Figure 4 is a diagram showing dis- 
play information of the first and second image 
display parts of the picture reproducer related to 
Embodiment 1 of the present invention. 
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[0025] In Figure 3, 301 is a pictorial image dis- 
played by the first image display part 3, and 401 
is a pictorial image displayed by the second im- 
age display part 4 comprising pictorial images of 
(l)to(12). 

[0026] In Figure 4, 302 is display information of 
the first image display part 3, and 402 is display 
information of the second image display part 4. 
[0027] First, the operation of the image data in- 
put part 1 will be explained. An image signal is 
input from the image signal input I/F 101 via an 
image input device (not shown) such as an ITV 
camera. Secondly, it is digitized by the A/D 
conversion part 102 and recorded in the frame 
buffer 105 connected via the switch 104. On the 
other hand, inputting of a frame separation sig- 
nal (e.g., vertical sync signal) included in the 
image signal by the frame separation-detecting 
element 103 resets flag 108 in addition to setting 
flag 106, and the frame separation signal is out- 
put to the control part 2. 

[0028] The switch 104 is then switched to the 
frame buffer 107, and an image signal of the 
"next frame input from the image signal input 
I/F 101 is recorded in the frame buffer 107 in the 
same manner as above. By repeating the opera- 
tion above, a pictorial image of each frame of 
image data sequentially input from the image 
signal input I/F 101 are alternately recorded 
temporarily in the two frame buffers 105, 107, 
and at the same time, the frame separation sig- 
nals are conveyed to the control part 2 and the 
first and second image display parts 3, 4 each 
time the input frames are switched. 
[0029] Next, the operations of the first and sec- 
ond image display parts 3, 4 will be explained. 
The first image display part 3 has display infor- 
mation 302 as shown in Figure 4 that defines a 
"reading rate" showing intervals for reading 



pictorial data and "display positions" and "size" 
in displaying retrieved pictorial images. In addi- 
tion, the first image display part 3 counts the 
number of frame separation signals input from 
the image data input part 1, and when the num- 
ber achieves the level defined by a reading rate, 
it retrieves pictorial data from the frame 
buffer 105 or 107 for which the flag of the image 
data input part 1 is set, and displays at the dis- 
play positions in the display size designated by 
the display information 302. 
[0030] As shown in Figure 4, because the read- 
ing rate is "1" as in the display information 302 
of the first image display part 3, the image is 
displayed each time a frame separation signal is 
input. Pictorial data is always displayed at the 
same position on the display screen, so it is pre- 
sented to an observer as a moving image. 
[0031] Moreover, as shown in Figure 4, in the 
display information 402 of the second image 
display part 4, a plurality (twelve in the figure) 
of display positions and special display designa- 
tion are defined. Input pictorial data is restored 
in a designated image dimension (170x120) and 
displayed with the display positions changed to 
the order defined in the display information 402 
by frame. More specifically, as shown in Fig- 
ure 3, the first frame is displayed at the position 
of (1), and each frame is sequentially displayed 
by changing its position to (2), (3), (4), and after 
it is displayed at the position of (12), it is dis- 
played as overlapping (1) again. Through the 
above operation, the most recent twelve sheets 
of frame imagery are always displayed in paral- 
lel on the same display screen. 
[0032] In the above case, because the latest pic- 
torial image sequentially overlaps the pictorial 
images already displayed (twelve frames), it is 
not easy to determine which of the twelve picto- 
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rial images is the latest pictorial image. There- 
fore, in this embodiment, as shown in Figure 4, 
it is stipulated in the display information 402 of 
the second image display part 4 to attach a 
decoration frame to the frame of the last dis- 
played pictorial image as a special display, and 
in displaying a pictorial image of a frame, an- 
other frame is displayed outside the pictorial 
image (refer to (5) of the pictorial image 401 in 
Figure 3), and the decoration frame displayed 
previously will disappear. 

[0033] As described above, in this embodiment, 
because all frame imagery input from the image 
data input part 1 in the first image display part 3 
is displayed at a fixed position in the size set in 
the display information 302, it is presented to an 
observer as a moving image. On the other hand, 
the second image display part 4 sequentially 
displays frames input from the image data input 
part 1 in parallel at a plurality of set display po- 
sitions, so each frame imagery is displayed on 
the display screen as a still image until that pic- 
torial image is overlapped. 

[0034] For example, in the embodiment above, it 
is assumed that an image signal is input into the 
image data input part 1 at 30 frames/second. The 
second image display part 4 sequentially dis- 
plays at display positions for the twelve frames 
defined on the same display screen, so the period 
during which one sheet of certain frame imagery 
is displayed on the display screen is 0.4 seconds. 
More specifically, that frames imagery is dis- 
played as a still image at a fixed position on the 
display screen during this 0.4 seconds. 
[0035] As described above, in this embodiment, 
the pictorial data input from the image data input 
part 1 is simultaneously displayed via two types 
of display methods, namely a moving image 
display by the first image display part 3 and a 
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parallel display of a plurality of frame imagery 
by the second image display part 4, so minute 
domain changes or changes in movement of an 
object or the like that are not clear in the parallel 
display of the pictorial image by the second im- 
age display part 4 can be observed with the 
moving image by the first image display part 3. 
[0036] Moreover, when reproduction of an im- 
age is paused such as when frame imagery needs 
to be observed in detail, if the image reproduc- 
tion advances by the time the pausing process 
actually completes since the indication of an 
observer for a pause, an intended frame is over- 
lapped by the subsequent frame in the moving 
image display of the first image display part 3 
and the image cannot be observed, but in the 
parallel display of the pictorial image by the 
second image display part 4, twelve frames of 
the latest pictorial images are displayed, so the 
intended frame is more likely to be displayed on 
the screen, and in that case, the intended frame 
can be observed without any operation such as 
frame-by-frame rewinding. 
[0037] Furthermore, as described above, it is 
advantageous that, through the special display of 
the last displayed image such as attachment of a 
decoration frame to the frame, an observer can 
easily determine which of the pictorial images 
displayed in parallel is the last pictorial image. 
[0038] 

Embodiment 2 

The picture reproducer related to Embodiment 2 
of the present invention will be explained. The 
constitution and the like is the same as Em- 
bodiment 1 described above. 
[0039] In Embodiment 1 described above, the 
reading rates of the display information 302, 402 
stored in the first image display part 3 and the 
second image display part 4 are the same, but 
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different rates may be set for the first image dis- 
play part 3 and the second image display part 4. 
[0040] For example, the reading rate for the first 
image display part 3 is set to "1," and the read- 
ing rate for the second image display part 4 is set 
to "150." The input of an image signal into the 
image data input part 1 is assumed to be 30 
frames/second as in Embodiment 1 described 
above. In this case, an image is displayed in the 
first image display part 3 each time a frame 
separation signal is input, so a moving image is 
displayed at 30 frames/second. On the other 
hand, in the second image display part 4, the 
reading rate is set to "150," so the number of 
frame separation signals is counted, and when 
the count achieves 150, pictorial data is input, 
and after displaying by the above method, the 
count is reset to 0. More specifically, after cer- 
tain pictorial data is input, the subsequent 149 
frames are not input and the pictorial image to 
be input next is displayed, thinning out the 
frames, so 1 frame of a pictorial image is dis- 
played every 5 seconds (150/30 seconds). 
Twelve frames of pictorial images are displayed 
in parallel, so pictorial images for 1 minute (5 
seconds x 12) are displayed in parallel on the 
same display screen. 

[0041] By performing the above, a longer time 
range of pictorial images can be displayed on the 
same screen in the second image display part 4, 
making it possible to observe changes that are 
difficult to determine with a short period of im- 
age display such as for river levels and weather 
changes. 
[0042] 

Embodiment 3 

The picture reproducer related to Embodiment 3 
of the present invention is explained with refer- 
ence to drawings. Figure 5 is a diagram showing 



a constitution of the image data input part of the 
picture reproducer related to Embodiment 3 of 
the present invention. Furthermore, in each 
drawing, identical reference numerals show 
identical or corresponding parts. 
[0043] In Figure 5, 1A is an image data input 
part, 120 is a recording device, 121 is an image 
data input I/F, and 122 is a decoding part. 
Moreover, 103 is a frame separation-detecting 
element for detecting the separation of frames 
comprising images, 104 is a switch for switching 
frame buffers to be described later that record 
digitized pictorial data, 105 and 107 are frame 
buffers, 106 and 108 are set when data within 
each frame buffer is indicated as readable by a 
flag that shows that the data is readable, and are 
reset when the data is indicated as unreadable. 
[0044] Next, the operation of the picture repro- 
ducer related to Embodiment 3 mentioned above 
will be explained with reference to drawings. 
[0045] The image data input part 1 of each em- 
bodiment described above is comprised so as to 
input an analog image signal from an ITV cam- 
era or the like into the image signal input I/F 101 
and digitally convert with the A/D conversion 
part 102, but in this Embodiment 3, digital com- 
pression-encoded image data is input into the 
image data input part 1 A. 

[0046] In Figure 5, the constitution of the image 
data input part 1 A in inputting digital compres- 
sion-encoded image data is shown. Digital com- 
pression-encoded image data is accumulated in 
the recording device 120 such as hard disk, and 
input from the image data input I/F 121. More- 
over, the image data input I/F 121 may include a 
network I/F part and receive image data through 
a network such as LAN. 

[0047] The input image data is decoded into 
frame imagery by the decoding part 122, and is 
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stored in the frame buffers 105, 107. Digital 
compression-encoding methods include interna- 
tional standard methods such as JPEG or MPEG, 
and the image data input part 1A is provided 
with a decoding part 122 compatible with an 
method of encoding image data to be input. 
[0048] According to this embodiment, it is pos- 
sible to generate and display an image that has 
been input or an image input remotely at any 
time and to observe and analyze it by digital 
compression-encoding. 
[0049] 

Embodiment 4 

In this embodiment, inputting including addi- 
tional information such as time of input ex- 
plained as image data and pictorial data of each 
frame comprising images. 

[0050] The picture reproducer related to Em- 
bodiment 4 of the present invention is explained 
with reference to drawings. Figure 6 is a block 
diagram showing a constitution of the image 
input device related to Embodiment 4 of the 
present invention. Moreover, Figure 7 is a dia- 
gram showing a constitution of the image data 
input part of the picture reproducer related to 
Embodiment 4 of the present invention. Fur- 
thermore, Figure 8 is a diagram showing a con- 
stitution of the second image display part of the 
picture reproducer related to Embodiment 4 of 
the present invention. 

[0051] In Figure 6, the image input device 6 is 
comprised of an image signal input device 601 
such as an ITV camera, a time information gen- 
eration part 602, external signal input part 603 
that receives signals from various sensor sys- 
tems or the like, and a digital encoding part 604. 
[0052] In Figure 7, IB is an image data input 
part, 1 20 is a recording device, 121 is an image 
data input I/F, and 122 is a decoding part. 



Moreover, 103 is a frame separation-detecting 
element for detecting separation of frames com- 
prising images, 104 is a switch for switching 
frame buffers to be described later that record 
digitized pictorial data, 105 and 107 are frame 
buffers, 106 and 108 are set when data within 
each frame buffer is indicated as readable by a 
flag that shows that the data is readable, and are 
reset when the data is indicated as unreadable. 
Furthermore, 130 and 131 are additional infor- 
mation buffers. 

[0053] In Figure 8, 4A is a second image display 
part, 420 is a frame data input part, 421 is a dis- 
play information memory unit, 422 is a frame 
data buffer, 423 is a pictorial data decoding part, 
424 is an additional information drawing part, 
and 425 is a display frame buffer. Furthermore, 
440-448 indicate data. 

[0054] Next, the operation of the picture repro- 
ducer related to Embodiment 4 described above 
will be explained with reference to drawings. 
Figure 9 is a diagram showing a constitution of 
image data input into the image data input part 
of the picture reproducer related to Embodi- 
ment 4 of the present invention. Moreover, Fig- 
ure 10 is a diagram showing an example of the 
display screen of the first and second image dis- 
play parts of the picture reproducer related to 
Embodiment 4 of the present invention. Fur- 
thermore, Figure 1 1 is a diagram showing dis- 
play information of the second image display 
part of the picture reproducer related to Em- 
bodiment 4 of the present invention. 
[0055] In Figure 9, image data used in this em- 
bodiment is comprised of frame data 610 com- 
prising pictorial data 611 of each frame com- 
prising images and additional information 612 of 
that frame. In addition, the additional informa- 
tion 612 is comprised of time of input 613 and 
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additional data 614 of that frame, and set via a 
method to be described later. 
[0056] In Figure 10, 301 and 311 are displays by 
the first image display part 3, and 401 and 
411-413 are displays by the second image dis- 
play part 4. 

[0057] In Figure 11, (a) and (b) are display in- 
formation of the second image display part 4. 
Furthermore, the display information (b) is ex- 
plained in Embodiment 5 to be described later. 
[0058] The digital encoding part 604 of the im- 
age input device 6 shown in Figure 6 detects 
separation of frames from an image signal input 
from the image signal input device 601, gener- 
ates the pictorial data 611 of Figure 9 that has 
been digitized and compression-encoded by each 
frame, and sets data of time obtained from the 
time information generation part 602 and addi- 
tional data corresponding to a signal input from 
the external signal input part 603 in the addi- 
tional information 612 of those frames and out- 
puts them. For example, in a case of Figure 6, 
when an alarm signal reported in detecting an 
abnormality in a sensor 1 is received from the 
external signal input part 603, Bit 1 of the addi- 
tional data 614 is set to 1, and when there is no 
input from the sensor 1, it is set to 0. Similarly, 
Bit 2 of the additional data 614 is set corre- 
sponding to an alarm signal reported from a 
sensor 2. 

[0059] The image data shown in Figure 9 is in- 
put from the image data input I/F 121 of the im- 
age data input part IB shown in Figure 7. Next, 
each frame data 610 is decoded to the frame 
pictorial data 611 and the additional informa- 
tion 612 by the decoding part 122, and stored in 
the frame buffers 105, 107 and the additional 
information buffers 130, 131. At this time, a 
switching control of the frame buffers by the 



switch 104 is carried out in the same manner as 
the embodiments described above. 
[0060] The first image display part 3 inputs the 
pictorial data 611 of the frame and the additional 
information 612 of those frames each time a 
frame separation signal V is input, and displays 
at predetermined fixed positions respectively as 
shown in Figure 10. 

[0061] Moreover, the second image display 
part 4A displays as the lower part of the screen 
in Figure 10 based on the display information 
shown in Figure 11 (a). A plurality of display 
positions is set in this display information as 
well as the embodiments described above, and 
the input frame data 610 is sequentially dis- 
played at a plurality of display positions. 
[0062] Furthermore, a display method for a case 
in which the additional information 612 of each 
frame meets a predetermined condition can be 
preliminarily set in the display information to be 
displayed. In Figure 11 (a), as a special display, 
Mark 1 is set to be displayed for a frame with 
the sensor 1 being on, and Mark 2 is set to be 
displayed for a frame with the sensor 2 being on, 
and as with 411 in Figure 10, the mark is dis- 
played superimposed on that frame. Moreover, 
by specifying a displayed pictorial image using a 
pointing device or the like, additional informa- 
tion of such pictorial image is displayed as 
with 412 in Figure 10. 

[0063] Next, the operation of the second image 
display part 4A will be explained using Figure 8. 
First, a frame data input part 420 inputs frame 
data from the image data input part 1 B accord- 
ing to display information recorded in a display 
information memory unit 421, More specifically, 
if a reading rate is described in the display in- 
formation as shown in Figure 1 1 (a), frame 
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separation signals V notified from the image 
data input part IB are counted, and when the 
count achieves a specified level of the reading 
rate, frame data 440 is retrieved from the read- 
able frame buffers 105, 107 and the additional 
information buffers 130, 131 referring to the 
flags 106, 108 within the image data input 
part IB. 

[0064] Subsequently, pictorial data 441 of the 
input frame data 440 is decoded by a pictorial 
data decoding part 423, and decoded data 446 is 
recorded at a display position specified by dis- 
play information of a display frame buffer 425. 
Moreover, additional information 442 of the 
frame data 440 is converted to display image 
data 447 by an additional information drawing 
part 424, and recorded in the display frame 
buffer 425. Data 448 recorded in the display 
frame buffer 425 is displayed on the display de- 
vice 5. 

[0065] At the same time, input frame data 443 is 
recorded in a frame data buffer 422. This frame 
data buffer 422 can store a plurality of frame 
data and record frame data and display positions 
of those frames. When Frame (a) on the display 
overlaps a pictorial image of another Frame (b), 
the display positions of Frame (a) recorded 
within the frame data buffer 422 are cleared, and 
display positions of Frame (b) to be newly re- 
corded are set. 

[0066] When a frame on the display is desig- 
nated, additional information 445 of the indi- 
cated frame is retrieved from the frame data 
buffer 422, converted to display image data 447 
by the additional information drawing part 424, 
and recorded in the display frame buffer 425, in 
order to display as in 412 in Figure 10. 
[0067] In this embodiment, regarding a plurality 
of frames on the display by the second image 



display part 4A, the frame data and the display 
positions of those frames are stored inside, so by 
designating the display positions of the frames, 
the additional information 612 of those frames 
can be immediately displayed. 
[0068] 

Embodiment 5 

In the embodiments described above, the second 
image display part inputs frame data at constant 
intervals according to a reading rate set in the 
display information, but frame data complying 
with a condition to which additional information 
of a frame is set may be input. 
[0069] For example, as shown in Figure 1 1 (b), 
additional information of the frame is investi- 
gated, and the frame data is set in the display 
information so as to be input only when sen- 
sor l^on or sensor 2=on as a reading condition. 
A frame separation signal V is input, the second 
image display part first inputs additional infor- 
mation of the frame data only, and examines 
whether such additional information complies 
with the reading condition set in the display in- 
formation. Only when the reading condition is 
complied, pictorial data of the frame is then in- 
put for display. 

[0070] According to this embodiment, the first 
image display part can be set to display a normal 
moving image, and the second image display 
part can be set to only display a frame with ab- 
normal incidence, so even if an abnormality is 
unclear with the first moving image display or a 
frame with abnormal incidence is missed, the 
abnormal incidence can be noticed immediately 
and observed in detail. 

[0071] The image data to input into the image 
signal (data) input I/F may be directly input 
from the image input device described above, or 
it may be comprised to accumulate the image 
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data generated by the image input device in the 
recording device once, and the image data input 
part retrieves the image data from such a re- 
cording device. 
[0072] 

Embodiment 6 

In the embodiments above, the additional infor- 
mation of the frame data input in the second 
image display part was only displayed within the 
second image display part or used to determine a 
condition. In this Embodiment 6, when the im- 
age data input part retrieves image data accu- 
mulated in the recording device, the additional 
information of the frame data input within the 
second image display part is used to designate 
the image data to be retrieved. 
[0073] In this embodiment, the operation for a 
case in which image data to be retrieved next is 
designated in image data on the display while 
images are being displayed by the first and sec- 
ond image display parts will be explained. 
[0074] First, the first frame and the last frame of 
image data to be retrieved next are selected from 
a plurality of pictorial images displayed by the 
second image display part, and those pictorial 
images are specified using a human machine 
interface device or the like. If the intended frame 
is not displayed on the display screen, frame 
data input from the frame data input part 420 is 
stopped, and frame data that has been input in 
the second image display part and recorded in 
the frame data buffer 422 is sequentially re- 
trieved and displayed. This allows for selecting 
the intended frame from the frame data input in 
the past. 

[0075] Subsequently, the second image display 
part notifies the control part of the additional 
information of the specified frame. This control 
part sets the time of input included in the addi- 



tional information as the starting time and end- 
ing time of the pictorial data to be retrieved next 
as in 413 in Figure 10, and orders the image data 
input part to input the image data. The image 
data input part retrieves the image data in the 
designated time range from the recording device. 
[0076] According to this embodiment, because 
the image data to be reproduced and display next 
can be specified by specifying a displayed image 
by the second image display part, a human ma- 
chine interface that is intuitively easy to deter- 
mine can be actualized. 
[0077] 

Embodiment 7 

In Embodiment 6 described above, the frame 
data input in the second image display part was 
directly recorded in the frame data buffer 422, 
but the pictorial data of the input frame data may 
be compression-encoded by a different method 
and recorded in the frame data buffer 422. 
[0078] The picture reproducer related to Em- 
bodiment 7 of the present invention is explained 
with reference to drawings. Figure 12 is a dia- 
gram showing a constitution of the second image 
display part of the picture reproducer related to 
Embodiment 7 of the present invention. 
[0079] In Figure 12, 4B is a second image dis- 
play part, 420 is a frame data input part, 421 is a 
display information memory unit, 422 is a frame 
data buffer, 423 is a pictorial data decoding part, 
424 is an additional information drawing part, 
and 425 is a display frame buffer. Furthermore, 
440-448 indicate data. 

[0080] Moreover, in the same drawing, 450 is a 
frame data conversion part, and 45 1 is pictorial 
data. 

[0081] Next, the operation of the picture repro- 
ducer related to Embodiment 7 described above 
will be explained with reference to the drawing. 
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[0082] The frame data conversion part 450 of 
the second image display part 4B shown in Fig- 
ure 12 converts the pictorial data 443 of a frame 
input from the frame data input part 420 to the 
pictorial data 451 that is smaller than the image 
dimension at the time of input, and records the 
smaller pictorial data 45 1 after the conversion in 
the frame data buffer 422 as pictorial data of that 
frames. 

[0083] Methods of converting the pictorial data 
in the frame data conversion part 450 are not 
limited to the above method. For example, if the 
input pictorial data is comprised of a value of 
each pixel (each small area that a pictorial image 
has been fract ionized horizontally and vertically) 
(described as "pixel image"), the pictorial image 
may be compression-encoded by the JPEG 
method, an international standard of a compres- 
sion-encoding method of digital still images, to 
record the coded data in the frame data 
buffer 422. 

[0084] Moreover, if the input pictorial data is 
expressed in a plurality of color information 
(e.g., Y (brightness information) and UV 
(color-difference information), or the three pri- 
mary colors, R (red), G (green) and B (blue), 
etc.), it may be set to only record specific color 
information of the above (e.g., Y (brightness 
information) or G (green), etc.). 
[0085] Furthermore, if the input pictorial data is 
inter-frame encoded such as in MPEG, an inter- 
national standard of a moving image encoding 
method, and H.263, the coded data may be de- 
coded once to obtain a pixel image and record 
the pixel image or the coded data obtained by 
compression-encoding the pixel image by the 
JPEG method in the frame data buffer 422. In 
this case, when the inter-frame encoded pictorial 
data is decoded, the pictorial data of the frame 



immediately before that frame is necessary as a 
reference image, so it is necessary to always 
generate reference images by inputting all 
frames and decoding them regardless of the 
reading rate or reading condition set in the dis- 
play information. 

[0086] According to this embodiment, the 
amount of pictorial data to store can be reduced, 
so memory necessary for recording can be re- 
duced, providing an effect to reduce equipment 
cost. 

[0087] Figure 12 is a constitution to input picto- 
rial data from the frame data input part 420 to 
the frame data conversion part 450, but the 
data 446 after the pictorial data input from the 
frame data input part 420 is decoded by the pic- 
torial data decoding part 423 may be input to the 
frame data conversion part 450. 
[0088] In each embodiment described above, in 
Figure 3 and Figure 10, a display by the first 
image display part and a display by the second 
image display part are shown to be displayed on 
the same display device, but they may be dis- 
played on different display devices. 
[0089] The image data input part of each em- 
bodiment described above has a constitution in 
which two pairs of frame buffers, additional in- 
formation buffers and flags are used alternately, 
but may have a constitution in which three frame 
buffers, additional buffers and flags or more for 
a plurality of frames are sequentially used. 
[0090] 

Embodiment 8 

In each embodiment described above, the con- 
stitution in which pictorial images of a plurality 
of frames of image data on the display by the 
first image display part are displayed in parallel 
in the second image display part is explained, 
but the second image display part is not limited 
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to this. In this embodiment, a second image dis- 
play part for displaying temporarily consecutive 
inter-frame difference images is provided. 
[0091] The picture reproducer related to Em- 
bodiment 8 of the present invention is explained 
with reference to drawings. Figure 13 is a dia- 
gram showing a constitution of the second image 
display part of the picture reproducer related to 
Embodiment 8 of the present invention. 
[0092] In Figure 13, the second image display 
part of this embodiment is provided with a frame 
data input part 480, an input frame buffer 481, a 
reference frame buffer 482, a subtractor 483, and 
a display frame buffer 484. 
[0093] Next, the operation of the picture repro- 
ducer related to Embodiment 8 described above 
will be explained with reference to drawings. 
Figure 14 is a diagram showing an example of 
the display screen of the first and second image 
display parts of the picture reproducer related to 
Embodiment 8 of the present invention. 
[0094] In Figure 14, 301 is a display by the first 
image display part, and 401 is a display by the 
second image display part. 

[0095] First, pictorial data of the same frame as 
the first image display part 3 is input from the 
frame data input part 480 of the second image 
display part 4C, and the pixel image of those 
frames is set in the input frame buffer 481. Sec- 
ondly, if the pixel image is not set in the refer- 
ence frame buffer 482, the pixel image set in the 
input frame buffer 481 is forwarded to the ref- 
erence frame buffer 482, and pictorial data of the 
next frame is input. 

[0096] If the pixel image is set in the reference 
frame buffer 482, a difference between corre- 
sponding inter-pixel values in the pixel image of 
the reference frame buffer 482 and the pixel im- 
age set in the input frame buffer 481 is obtained 



with the subtractor 483, and the value of the dif- 
ference is set in the position of the correspond- 
ing pixel in the display frame buffer 484. This 
pixel image of the difference set in the display 
frame buffer 484 is displayed on the display de- 
vice 5. 

[0097] In this embodiment, the pixel image to be 
set in the reference frame buffer 482 is updated 
each time frame data is input, but it may be set 
to be updated at predetermined intervals. The 
difference with the predetermined reference im- 
age may be set to be always obtained without 
updating the reference pixel image. 
[0098] In this embodiment, because a difference 
between input frame imagery and reference 
frame imagery is displayed by the second image 
display part 4C, minute domain changes in the 
display screen can be prevented from being 
missed. Moreover, an actual image of an object 
is not very clear with a difference image by the 
second image display part 4C, but it can be con- 
firmed by a display of an actual image by the 
first image display part 3. 

[0099] In this embodiment, a difference image 
with a reference image is displayed by the sec- 
ond image display part4C, but an image ob- 
tained by space-filtering (e.g., edge image) or 
color conversion processing (e.g., high contrast) 
input frame imagery may be displayed in the 
second image display part. 

[0100] In Embodiment 1 described above, a 
special display that attaches a frame to a picto- 
rial image displayed at last by the second image 
display part has been explained. Moreover, in 
Embodiment 4, a special display that attaches a 
mark to a pictorial image in which additional 
information meets a predetermined condition has 
been explained. Settings of special displays are 
not limited to these, and for example, a special 
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display that attaches a frame to a pictorial image 
of a predetermined time or a pictorial image se- 
lected and specified on the display screen or the 
like may be set. 
[0101] 

Effect of the Invention 

As explained above, the picture reproducer re- 
lated to the present invention is provided with an 
image data input part for sequentially inputting 
image data comprising temporarily consecutive 
pictorial data, a first image display part for dis- 
playing the image data input from said image 
data input part by the first display method, and a 
second image display part for displaying the 
image data input from said image data input part 
via a second display method different from said 
first display method, so it has an effect to facili- 
tate observations with fine pictures. 
[0102] Moreover, as explained above, the pic- 
ture reproducer related to the present invention 
has said first image display part sequentially 
display the pictorial data input from said image 
data input part in a predetermined first image 
dimension, and at the same time has said second 
image display part sequentially display the pic- 
torial data input from said image data input part 
in a predetermined second image dimension dif- 
ferent from said first image dimension, so it has 
an effect to facilitate observations with fine pic- 
tures. 

[0103] Moreover, as explained above, the pic- 
ture reproducer related to the present invention 
has said first image display part display the pic- 
torial data overlapping to be sequentially dis- 
played at a fixed position on the display screen, 
and at the same time has said second image dis- 
play part display the pictorial data to be sequen- 
tially displayed in parallel on a plurality of pre- 
determined display positions different from said 



fixed position on said display screen, so it has an 
effect to facilitate observations with fine pic- 
tures. 

[0104] Moreover, as explained above, the pic- 
ture reproducer related to the present invention 
has said first image display part sequentially 
display the pictorial data input from said image 
data input part at predetermined first time inter- 
vals, and at the same time has said second image 
display part sequentially display the pictorial 
data input from said image data input part at 
predetermined second time intervals different 
from said first time intervals, so it has an effect 
to facilitate observations with fine pictures. 
[0105] Moreover, as explained above, the pic- 
ture reproducer related to the present invention 
has said image data input part sequentially input, 
decode, and output digital compression-encoded 
image data, so it has an effect to reduce record 
volume. 

[0106] Moreover, as explained above, the pic- 
ture reproducer related to the present invention 
has said image data input part input pictorial 
data of each frame comprising images in con- 
junction with additional information of those 
frames as data of those frames in inputting said 
image data, and at the same time has said second 
image display part display the additional infor- 
mation of the displayed image by specifying the 
displayed pictorial image, so it has an effect to 
facilitate observations with fine pictures. 
[0107] Moreover, as explained above, the pic- 
ture reproducer related to the present invention 
has said second image display part only display 
pictorial data that complies with a predetermined 
condition among a plurality of sets of pictorial 
data displayed in parallel at predetermined posi- 
tions on the same display screen according to a 
display method different from the other pictorial 



Japanese Unexamined Patent Application Publication 2000-47651 
(16) 



data, so it has an effect to facilitate observations 
with fine pictures. 

[0108] Moreover, as explained above, the pic- 
ture reproducer related to the present invention 
has said second image display part compres- 
sion-encode pictorial data input from said image 
data input part via a method different from the 
pictorial data and accumulate it in a buffer, and 
in performing a consecutive image display 
process, said second image display part retrieves 
the compression-encoded pictorial data from the 
buffer, and reproduces and displays it, so it has 
an effect to reduce record volume. 
[0109] Moreover, as explained above, the pic- 
ture reproducer related to the present invention 
has said second image display part display a 
pictorial image resulted from performing a pre- 
determined image conversion process on picto- 
rial data input from said image data input part 
and reproduced, so it has an effect to facilitate 
observations with fine pictures. 
[0110] Furthermore, as explained above, the 
picture reproducer related to the present inven- 
tion the displays image displays superimposed 
by said first and second image display parts on 
the same display device, so it has an effect to 
relatively facilitate observations of images. 

Brief Description of the Drawings 
[Figure 1] A block diagram showing the overall 
constitution of the picture reproducer related to 
Embodiment 1 according to the present inven- 
tion. 

[Figure 2] A block diagram showing the detailed 
constitution of the image data input part of the 
picture reproducer related to Embodiment 1 ac- 
cording to the present invention. 
[Figure 3] A diagram showing an example of the 
display screen by the first and second image dis- 



play parts of the picture reproducer related to 
Embodiment 1 according to the present inven- 
tion. 

[Figure 4] A diagram showing display informa- 
tion of the first and second image display parts 
of the picture reproducer related to Embodi- 
ment 1 according to the present invention. 
[Figure 5] A block diagram showing the detailed 
constitution of the image data input part of the 
picture reproducer related to Embodiment 3 ac- 
cording to the present invention. 
[Figure 6] A block diagram showing a constitu- 
tion of the image input device of the picture re- 
producer related to Embodiment 4 according to 
the present invention. 

[Figure 7] A block diagram showing the detailed 
constitution of the image data input part of the 
picture reproducer related to Embodiment 4 ac- 
cording to the present invention. 
[Figure 8] A block diagram showing the detailed 
constitution of the second image display part of 
the picture reproducer related to Embodiment 4 
according to the present invention. 
[Figure 9] A diagram showing a constitution of 
the image data to be input into the image data 
input part of the picture reproducer related to 
Embodiment 4 according to the present inven- 
tion. 

[Figure 10] A diagram showing an example of 
the screen display by the first and second image 
display parts of the picture reproducer related to 
Embodiment 4 according to the present inven- 
tion. 

[Figure 11] A diagram showing display informa- 
tion of the second image display part of the pic- 
ture reproducer related to Embodiment 4 ac- 
cording to the present invention. 
[Figure 12] A block diagram showing the de- 
tailed constitution of the second image display 
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part of the picture reproducer related to Em- 
bodiment 7 according to the present invention. 
[Figure 13] A block diagram showing the de- 
tailed constitution of the second image display 
part of the picture reproducer related to Em- 
bodiment 8 according to the present invention. 
[Figure 14] A diagram showing an example of 
the screen display by the first and second image 
display parts of the picture reproducer related to 
Embodiment 8 according to the present inven- 
tion. 

Figl 

— *"3E 

Coi^olJ 

[First image] , 
[display part 



[Figure 15] A diagram showing an example of a 
screen display from a conventional picture re- 
producer. 

DESCRIPTION OF THE NUMERALS 
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display part, 5. Display device, 6. Image input 
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mmi&T- $ a*»*> hxfiis tcmm mum 
mumzcommm^mt, ffizmmr-zAftmfrhA 

nfc»«<D«mta«k:afe w»ft -r £ c <t t -r £ is 

# X*»*> 6A# L/fcBI» * 5 tiftm 1 

oB#raraiisri«;xw±^^ & 1 1 4> cc . 

«%W#TA*-r^i<hfcCC, 

[ tmm 7 : mieu 2 ©(*«sw8b» , «— ^his 

<D&. focowfa f-zt. £ mm-fimaz-y x^m 
the ±*mk±?&m&m6zm<Dmm&t£gkm. a 



W20 00 - 47 65 1 

2 

[ nmm 9 ] mm 2 0iM**t*u*t2 , mtsikmr- 
* Atmfr t>A)i l x w£ l temmr- 5 cc . ^tb&m 

i m^m 1 0 1 mt&m 1 &x*m 2 <ov>k&mmmt & & 
-r&m&m 1 frhtmrns tx^^ti^Hamcomm 

[0 00 1] 

xAt)Ltcmm<Dm%^fcm, ftfamcm^zwmm$i 

[0 00 2 ] 

^~7'icmmnxi,>&mm&m*M9n?z<Dfrx& 
[0003] 3£/c, 

v^^ ^^6A^f$tx^f*«®#^pjmciaii • n&L 

u^&xm7fkLx^z><Dx<h-ox, msKomvun^ 
mvn^nk isXi<>2><Dxtem<<\ 
[00043 *fc, »*oK«-iB«9rffl^ 

[0005] ffi*©»*«^itw:^c*rHffl*#JWL/ 

B15», Mill ff^«lRNIM97-69 
[ 0 0 0 6 ] m 1 5 CCfcC^r , SSSB 15 0 1 
^nSRl 5 0 l-CTR-Tct^tc, iai»3nrc^B*«<DMi<D 



3 

7u-A£#tm«^-£*K#aiu ^1 502 
m 1 5 0 1 <b. ihmmm^n *>mm%K 1 5 0 2 n 

[0 00 7] 3 WHO»#f«rffll^h5IWl« 
&nHfiH fc tc3fe?ij*^-r & <D& $> Z> ifi . ife^M^r i ffc 
[000 8 ] 10 

a-CL^>W^*^L,«:i^-C. lft»<7>Kta-t>^*f«:!f 9 
ISCC »«*^ra:<DW 9 g*. 0 <#S#* & □ Wit K, 

»±*JB^ t x ^ e> , *a«tc!*»if 

m£ If - * f 6 * * 1 1 > 5 ihh & o fc„ 20 
[000 9] 

±CC2:X5cff)Cca6^rW*«*f («T rifA* 

lire «fc 1^ nH^M o fc a 
[0010] c©»wtt, ffiraofcniii^fciBarsfc 

*Ci#**SR*W^»£»St: 30 
[001 1 ] 

[ISS€ft?^T^/cfi6<D^ia] C<D#WC«S!ft*S£ 

-^A^sp^eA^^/c^f 1 -^^^ i cD^^it? 

mmt&rn l . iiMeK*^- * A*»*> 

SB 2 <om7ntt£ X&rik? Z>m2 (DmiPMfnm t * fix. fc 
[00 12] *fc. coxqB«cft«R*H^ttBlt 1 W 40 

ear i <o»«*7RW^. wsw*?*- * a#«*>&a# 
iai*«f s -*A*»*6A*bfcm»!f s --**«frK» 1 

[00 13] CC0f69i6cff4!*«»g£«Btt. W 

iB«r 1 ©wk*w, i«:>cw^«^-r S(B«^** 

le* 2 ©■**««»#. W^S^^SH*^-** 50 



»RI2 0 0 0 - 4 7 65 1 
[0014] C<WfeWc«4KlRW*»jBtt. S9 

ibs i com&MmBfiK mnm&T- *a*sim>6a/j 
m£$ktjk?x>LLi>i l c> mzm2commm^%w\ mrsa 
mmmmL t <mte&^&®m2ritcm2<Dmrmffixm 

tcm&7*-z*mxAt>L. m.m,xmtrtr&b<Dxi> 

[0016] *^c, c<D«w*c«*«k«w*«jK5a. mr 
ei*** 1 - * a*»**. msaft*^- ^ *A^rr 
cc, tt**«Rjcrs*^ u-A^f-^i or. iS^u 

- a (Dili* 7 s - £ <fc aft^ u - a QttKttW* fiHf r A# 

^ -2><h 4> tC . MIB^2(0^^^^;gP^. ^^brc^-S 

[ooi7] uttc, c<Dmnicmzmmn%L$kmz. m 
t Em 2 (DmpM^m* ra— a«»H±<D^«f>»3e* n 

- ^ L&mK&&^Jimc&^xmT!k?z> t><Dx&z>„ 

SSI 2 coift*a*SR^ . ffiffil!**^- $ AftWfrhAJj 
[0019] */c, CCWftWCc:«5tt*wa*IBa. « 

ia» 2 <D^*a^^ . ffir ihb^# ^ ^ a^ apa* e> a^j 

Ut»4lfemf-*(c ( ?ibnedftft:H*9EiMB 
ffl*«LfctS*<7>iiiI**«^4fc©^*S 0 

[0020] shic ccommc^mmn^mt. 
mm i Rvm2<DmmtfTkmc j:^mm^m^\m—<o 

[0 021] 

ff^ 1 CC«*K*W*^«cr?c>rHffi«:*JHl/a:3W6 

Mwr*. mitt, cvftwtDmmoBmiicmzmm 

[OO2 2]01ic*5^t, 1 »K*^-$ A^SP, 2 
3«mi<D^*^SP, 4OT2(7)«^ 

[0 02 3 li2^t, lOll**iitA»I/ 



f . i o 2\th/umm. i o 3&mm*mm?z>7 

4 it? *i> $ )Vit$ ft fc®<g>if — ^ ^iei^-T £«i£<D v 
7(J7l/-AM^ 7l 1 0 6SO'l 0 8«ft^b-A 

■te? h3ft& 0 

[ 0 0 2 4 3 oarcc, HdidiL/fc^*S<D«JJ» 1 

m^»<ommc^xmm^m Ltufrhmwrz. io 

[002 5] 03«C*i<,*T . 3 0 1 5*31 1 0»fft^» 
3tC<k0^3ft*®!«. 40 1 (£ffl2<DR4fc&j%ffi4 

& J: ») 3 ft *H*r (D - ci2D«aH»-c«RS $ ft r 

[0026] H4 *c*5i»r. 3 o 2temi<Dmmmmm> 

3<D«St»«. 4 0 2«IB2C!>!*#«7ftaJ4©«5x»« 20 

[0 0 2 7] *a*bb i oiifi£*«w-r 

tefsw&tkikim&ti i /f 101 ^f>AM§. x 

SC. A/DSQft»l 0 2T?^* ^frMfcU 

7b~AKwoi*ai»i o 3-c. rnmmm 

K«ti47U-AKW»)W (ex. j&jftlBDWt*) 
*AZ}?Z>t. 77yi064i2yht44ifcK: i 7 
7^1 0 8^'Jt7 hi, *II®g(52CC^ U-AEWOfI 30 

[0 0 2 8 ]^bt, X>f 04*7l/-^?7 
7107 Ctfljg**.. !WR«#A* I/F101 *6 A 

«0jS**CCJ:*K !fc*«^A* ■ l/F 1 0 1*6«* 

1 0 5, 1 0 7fc3KHfc— »K»T*±H 
ffiSCc. A^7U-A^0»to^c:i5c. fWiSPfi|5 2 3fe^ 
CC»lRC>f»2<DI!ftfR^aB3. 4 £C7 U - A|Z$$3 ft 40 
^#iifrlSft&„ 

[oo2 9] xk, mi^um2(omm^^3, a<d 

•C3E* 3 ft T I > £ffitC ft ^ fcWWC . ttflfcf 1 - £ A*» 1 
(D^^-fe* h3ft"CC*^l»J®^U — A^^^r 1 0 50 
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302 rfg^s ti/cn^fiaaiysst y xtt^t 

[0 0 3 0 ] H4fcjR*J:9«C, W 1 ©lfcft5^aiX3<D 
3*7nttf«3 0 2<Dm&. %t&muv- hit r 1 j r^>4 

or, ^u-AKWOff#^A*$ftSff(cffl»*^* 
^f-ri*5ctt^ a wft^-^ttfitcc, a^M±cD[Hj 
— ©fiiBtc^TS^ftsor. «»#cc«:«iHj«i Lta 
^£ft& a 

[0 0 3 1 ] H-.4iciiVrj:9«c. *2 03!ft«*^ 
»4<D*m«f«4 0 2t«, »K (Ht?« 1 2i) coa 
^fi^i. #^^J§^5£«3ftTt*£ 0 A^U/cL*i 
(R-r-^tt. JBSEOHflW A X ( 1 7 0 x i 2 0 ) CCfS 
SI. *«ffi«*»mtWR4 0 2ec5ei»3ftri,»4J(a» 
icy u-A»teSSAT3l*irrs. EPfc, 13 3 Cc^-Ttt 

tc, iajo7i/-A« c i ) <D&mcm^i>. mx 

(2) . (3) . (4) <b7U-A»tcf4iS*a^T« 

mt, (i2) o(aa*r^L,/d^. »tt(D* 

ft£*tcft& 0 

[0 03 2] ±8B<D»^ SifrOHffti*. (127U- 

a#) Mcc^3ftri^iffim<D±cc)i:xJi**Sft*r 

^<(DT, 1 2 tk<DBB*CD 0 % . ^ftA««*ff©iffl«ir* 
^«CC»2(0|«^*^4O«S^«4 0 2CC. ^ 

tC^^^m (13 3 COP] (^4 0 1 CD (5) #BS) 0. «ff 

[0033] vxhomc #mm<Dnmv&> m 1 

3 r - $ A^gp i*>e»A*sn447u 
-Amm^m^mm3 o 2-cs^3ft/cHsoegsa c 

**CCfcS„ *2(D»«s«nWB4-C». (feflfsf 8 - 

5?A^S51^^A*Sft^^U^A^, SJStBseSftfc 

w. »Bffl«**±»*3ft^*r<Diffl. »±m»±Lxm 

7SBffl±CC*?n3ftrc»4. 
[0 03 4] -hlB^OB^r, ^-r-^A 

^SB 1 tCift#^^ 3071/- A/#-CA^J3ft^> t fg 

l$n/c 1 2 -7 A»<D^ffi*tc. W:X*^3ftT 
iKOr, 4>^> U-ABD«*s*^|ilBiJrCc^7S 
SftTUSESfBIWO. 4»IBt&&. Bn%, CCDO. 4 

[0035] «ii€D«cc *i5jii©»«rtt. mm?- 

fjkM 3 ^«i@B«iR7^ <b . » 2 ORffeft *nfl5 4 CC J; Z> 



mmv \zm f Kc < t *iiiiirtoa»/jA«cM[«i<o§aEft^>fe!??{* 

©tt#<D£{b#tt3t 1 OKfR»««3 Cc J: S 
jh<0*Sw* £Rt(c ±teH!#5E7 IT £ jgOFfl te 

[0 03 7 ] 2 ±^(DJ:-5(C % **?S*fliift*; 
Mir * -5 S» K*s* £ 0 

JbE©WlK0»«l 4B«r**. 
[0 03 9 ] ±e©HMi<D»» 1 fcfcivc. & 1 <d?&« 

»«30 2, 4 0 2©K*ai/ U- HiHlt*«7fc 
i)K *108W»Rm8B3im2 0*««7S»4r»tt5 

[004 0] jR 1 0M9lWtk»3<Dlit&mi, U 

— h* r 1 j % »f2<0»««S*|I4<OK*UUU- h* 

ri 50j it^ c jft^ir- * A^SB 1 ^<D\&mm<D 30 
A^te, ±8BCD*S6(DJ&W 1 t ffl D 3 0 y l> — A/5B?i 
T£„ C<D«te. »l<OUMR*^aB3rW. 7U-Ag 

*^g|$4 1«. Ht^tH U h * r 1 5 0 J fcBHES ft 

*T. *:<D'AlcAtJ £ ft &®j{££^t?jrf * <t i > 5 «fc 3 (c , 40 
7u-A*ragii»rA*-rsor. 5# (i 50/30 

BMfc*^ja^T£<or. i»(5»xi2) p^5K>ni 
&*<n— **Biffi±(c ifeW«^ $ ft £ *4t & & . 

[0 04 1] JW±<7>«fcc-riT«. »2©!ft«£SmSM.iC 
*C*r , J: «9Sl>BSIffl8Gffl<D[ii#^rHi— HiiiiccSWVr 

[0 042] **6<DJf>S»3 . C ©^(OHJSg(^ff^3 50 
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£ 0 135 tt. C(D«WO*J6<0»«3&c(*4tttfeS5fe4fe" 
■Olfcft^-^A^WOfllftRi^TiaT?**. tc*. & 

[0 04 3] H5tC*5C^r, i ' AteWF-ZAt)t&. 

12 0tt»a»»B, 12Itt»ftf-dfAAl/F. 1 
2 2fcfc«#8Rr*£ e */c, lOSWMMt^^ 
U-AOEW^**IHi"r4 7U-AKW*)1ftfflSB. 10 
4 U-r y ^ £ ;l/ft3 ftfcBHStT*- £ £ tali T 7 
l"-<Urty7T*$)t)i&Z.ZXJ 105SO10 
7tt7l/-AA 7 7r. ]0 6a^l0 8{^7U-A 

> 1 ; * ^ 7 w cd ? - $ m l> ^mv ^^ct^-rv 

[0 0 4 4 ] ^Sf«C, fr^Ufc^«0»«8 3ec^^RfR 

SSSlOllff ceo t » r H ib'«r*Ml o 6 sft^ -r ^> « 
[0 04 5] iiaS^itO^SStDWfc^- * A#S$ I 

». Wl^fi^A^; I /F 1 0 uc 1 TV^y 793^60 
r^nyilfc«^*A*L, A/D$ft»l0 2tf ! -f 

[0046]H5CC^y S^^iHIIilHifbStifcBMfc^ 

-Ff^ ^!¥<7>8a»«tB 1 2 0 Cc»«d tiTfc 0 . R 
ff^-irA^l/F 1 2 l^A^tS. */c. 

l/F121{C*9h»7-^ I/FSB*^ t 

[0047] A^sti/cWft^-^^. a-^api 2 2r 
■m j p e g^m p e Gm<Dmmmmj5jm&$> 

0. ««r-^A^IH51 Ai^AASti^W^^^^ 

mt^^cMttutcmnm 1 2 2 ^«x.^ a 
[0 04 8 ] ***i©jf^tcj:ntf . m^cAt) otm 

tR-^i*fSiftrA^7LA:Bftfft-cfc % ^^^FEtB'iRF-^ffc 

[0 04 9 ] *«KDJg«84 . *H35fcO^JI8r«. Ijfeft^ 
t^t?fe<. A*l««l*<D«l|«t»«*d«>TA*T*»^ 

[0050] c<o^<75ie*cDfl5sg4 ttffiz>mmn*£m 

■Ccoc»rBtlf*#fl«0^ds^ttWTS„ H6ii. CCD 
«9JO**OB»4 tc«^»«A*«K©fllfltt>Sr ^ 

4 CC^^^mw^S^flfe^- * A**<D«SE4iR-r 
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[ 0 0 5 1 ] h e tc*» t >r . mm Amrns 6 it I T V 
*^5*©»h»<s#a**k6 014. mmm&%.i&§n 

6 024. &®-b>-y-m&m^om^z$:m?WM 

(B^At)i$G 0 3 4 . f< i>iuH?#ftffl$6 0 4 4Tflt 

j$<*ft3. 

[0 05 2] 17(Ciii»t. 1 BtJ^f-^A^SP. 

1 2 o«idi*^g, 1 2 1 immr-zAt) \/f 1 

U-A/<»7rtt/J0*jl4x^ l 0 5SW1 0 

7IJ7I/-AM,7t. 106Syi08JJS71/-A 
/< 7 t PKD^-HfimfrM U^mV&ZC t &9fk?7 

9 V-cm^tti L amteW&lc-te y h . ^plfig&ii&ii 
•fe * F 3 ft <* 6tc . 1 3 0 SO' 1 3 1 »tt«t!H«^ 

[0 053]i8(i:fel>T. 4A«92(D^^I|!, 
4 2 0 \tv L— Af - ^A^glS. 4 2 1 t*aS>jvfi»$Rietg 
SB. 4 2 2iJ7l/-Af-$^-;7 7 , 4 2 3(*HI^7=' 
-fflWas. 4 2 4 »^tHtMRfiiBaiS. 4 2 5B«Sffi 

7 1/-A'<-;-77W, Sc*s. 4 4 0-4 4 8lif- 

[ 0 0 5 4 : -i mc . mmotc^mmm 4 tc^sm* 

S*^ffi<DWf^ {cot >mffl*#JS t/ ?j $93*3 . 

139 it. coftwvmmoi&BA t,mzmmm&%&<D 

x&z. ttc mi os*. c(D3m<ommm&Ai,c% 
zmmmmmmom 1 i&um 2 (otumwamo^imm 

mm 4 iz&zwmntmmom 2 ©i»««^gp®^^ 

[0055] H9{cfci^r, *mm<DBm-cm<.>z>9k®. 

14. m7i—A<Dtfmmm 1 zLxmrnsnzyv 

2«. mvu-Aoxtimme 1 3tttm-?~-&6 1 4 

[0056)810 iC*j^r. 30 1M3 1 1 1 
©!ft«a^SC3{CJ:S^. 4 0 1. 4 1 1 -4 1 3« 
J»20!fc«i«7KaiJ4KJ:4amr**. 

[0 05 7 ] HI l<C*5l>r. (a) SCMb) WJU2 

( h ) mkmtznmomms vmi-rz. 

[ 0 0 5 8 } a 6 JCin-r(*ttA:*JitB 6 ©7* 4 is $ )in 
mt®6 0 4 it. A#3£g 6 0 1 *»6A*3ft 

K:f r Yy^;HtLJI«BT?#ftU/cia9©ffl»Ef r -*6 1 
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-*4. J1-3Wi*A**e 0 3*>P,A*$ft*[g^c*f 
tc.-.Ufcff/JU7 s -^^7b-A©ft)lt**g6 1 2 5C-fe? 
or 111733- pk*(i. |6cd^, •fe>-9-i-csis 

*fc*B t fc 4 » tcfttR $ ti S T 5 - Afg4?*?f SPfS^A 
#»6 0 3 *>6«flrt,fc£ SffCtfiJO^-* 6 1 4©f , 

M % 1 tc. l *»e.©A*3W*t>i«^«o«:-b » 

[ 0 0 5 9 J a 7 Ct^-mff-er- * A*J» 1 BOKft f' 
10 -$rA2M/F 1 2 I*>€>, HQfc.Ts-rifcij^-aitA 
^-T-& 0 ^AfC. #7 I — Ax- £6 1 O^fg^gsi 2 2 
r. 7U-Aiff-S6 1 1 4 ttllfjltfg 6 1 2Ctfg# 
L. 7b-A«,7rl05. I 0 7 RCKffWt««/< -j 

vri3 0. i3iK«n. ccr. X^.flO 

4 cc i s 7 u- ak „ 7 t- <Dm <o tsatm'mx ±t2©^ 
[ o o e o ] * i vmto&ms v\ — ae^»j ft 

•^V^rA^-r-S^tC. 7U-ACDi«f-{i6 1 1 <t!$ 
7U-A©#)S«ff86 1 2£A*U 01 OtC^fJ;^ 
20 K. &*^&&«3ftfc@£©&gK^f*„ 

[0 06 H ^f2©|U«^Sn4AW. (31 l 

( a ) ^■m-t^.n^m.^m-^^m 1 0 ©TS©BitS© J: 

PJ«tC. ^©*7T^fir|g*i^3ftrte*3 , AfibtcV 
10W. **<0*Sfl[*{Cl»:X*^3ft 

[0 062] ^cfc, §7 U-A©ttHtf$H6 1 2 *s-j; fe 

i?t**}«Cs9:5eL/-C48#^-*-5**iT#*, 011 
30 (a)r{*. S««milt. •fe>tl*son'CW7 
U-A(C?-?l, •fe>-^2*on(C^ofc7U-A(c 
-7"^2 ZmnklT&WimZtlXtot) . ®10©4 1 1 

ftrc»*iBfli**8^r*4. si o©4 i 2<Dmicmw 

i%otfmwmmm± ic&nk $ ft & „ 

[006 3] :ACC. I3 8^fflt»rm2©ift^^g|54 A 
©ttfP*»Wr*. ST'. ^U"Af ; -»A73gP4 2 0 

40 8eor»«?-*A*an B*e,7u-Af-ji^ 

■T^„ BP^. *mtt$g^, Eli i (a) ©J:^cc. ^ 

1 B*»6ajEDSft47u- AEfJi3fa#V^it^t. It 
»«**«*ffiou- KWSftSftfciiecitc-afc^tc. 

^^-*A/3S!5 1 ni*J©7 9>/ 1 0 6 . 10 8^#SSl^ 
X. m.frtiil,Bimj:7 l/-A'^7r 1 0 5. 1 0 7 <b 
f=tHfB*B-'f 777 1 30. 1 3 1 A>f>7 i/-Af- H 4 
4 0 &M*WT. 

[0 0 6 4] ^CC. XJjLtcV Is-Af-'-Si 4 4 0©j® 
50 tf->4 4 ltt. Hl^T ; -^fg^|54 2 3-cm-^b 
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H-Sff : -£4 4 6^ffl7U-AA'^77 4 2 5 

M4 2 4 Vm^m A J - isr- £ 4 4 7 fC^fft L 

a- 7 7t4 2 5Kfe^3ft/c:f-£4 4 8tt. 

[0 06 5]^, A*lfc7l/-Af-^4 4 3 
«. 7U-Af-^^ ;774 2 2ic§dirr£ u C©7 
l/-Af-^t,7 7 42 2(t ISSfecO^ U-At*-* 
*t&#TC*, ^ U-A^-^ilg^U^AO^^^ 
^-T^ 0 ^#<D^U~-A (a) ^S'lO^U-A 
(b) <0Bfme±S££n£i^^ :7U-A^-£M 
4 2 2|^Cl6l$£ftTt>£:7U~-A (a) CDH^ 
TU $r/c&C]M£tl£:7 b~A (b)Ol 

[006 6] «^CD-7 A^Jg^3tlfci#^«, 

U~A(DWfi?t#$R4 4 S&^U-A^-^M 
■77r422^6Ml, WK«MRiaia»4 2 4r* 
^-f ^-^-r-^4 4 7 ^C^t^L-r^TFffi^ A;% ? 
>> y 4 2 5 KfEfSL , HI 0O4 1 2 <DJ; 5 CC*^T 

[006 7] *«*0»*t?«. *2 ©!Wfc«5«B4 A 

u-A^-^^A^jT^fllicurfei^o 
[0069] . {Mil ( b > sc^-r**^ ft*Mt 

■fe>ifl=on, $/dit>t 2 = o n(Dl^(?)^7 U 

-fit, ^ffiL^mcii^ixri^ 

[0070] **«SOffJ«CC <fc*l«, HI 1 CDRflt&Ktt 
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